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4.2.3 Normal (Gaussian) Distribution 

The normal distribution is by far the most important probability distribution. One of the main reasons for that is the Central Limit Theorem 
(CLT) that we will discuss later in the book. To give you an idea, the CLT states that if you add a large number of random variables, the 
distribution of the sum will be approximately normal under certain conditions. The importance of this result comes from the fact that many 
random variables in real life can be expressed as the sum of a large number of random variables and, by the CLT, we can argue that distribution 
of the sum should be normal. The CLT is one of the most important results in probability and we will discuss it later on. Here, we will 
introduce normal random variables. 

We first define the standard normal random variable. We will then see that we can obtain other normal random variables by scaling and shifting 
a standard normal random variable. 


A continuous random variable Z is said to be a standard normal (standard Gaussian) random variable, shown as Z ~ iV(0,1), if its 
PDF is given by 


fz{z) = 



for all zgM. 



is there to make sure that the area under the PDF is equal to one. We will verify that this holds in the solved problems section. Figure 


4.6 shows the PDF of the standard normal random variable. 



Let us find the mean and variance of the standard normal distribution. To do that, we will use a simple useful fact. Consider a function 
g(u) '• R —y R. If g(u) is an odd function, i.e., g(—u) = —g(u), and | Jq g(u)du\ < OO, then 


For our purpose, let 



g(u)du — 0. 


3 ( w ) 


,2k+l 



}■ 
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where k = 0, 1, 2, .... Then g(u) is an odd function. Also | J (j g(u)du\ < OO. One way to see this is to note that g(u) decays faster 
than the function exp{— u} and since l/ 0 °° exp{-u}du\ < OO, we conclude that | /“ g{u)du\ < OO. Now, let Z be a standard 
normal random variable. Then, we have 


EZ 


2k+l 


-f 

y/EFJ-c 


u 2k+1 exp 


T \ du = °’ 


for all k € {0,1,2,..,}. Thus, we have shown that for a standard normal random variable Z , we have 


EZ = EZ 6 = EZ b 


0. 


In particular, the standard normal distribution has zero mean. This is not surprising as we can see from Figure 4.6 that the PDF is symmetric 
around the origin, so we expect that EZ = 0. Next, let's find EZ^ . 


ez 2 = yb Eoo u2 ex p{ - f } du 

1 OO 

= yb - uex p{-f} + 

L J —oo 

+ —= f '^ x exp| — -y-1 dii (integration by parts) 

=sz^{-i}du 

= l. 


The last equality holds because we are integrating the standard normal PDF from — oo to OO. Thus, we conclude that for a standard normal 
random variable Z, we have 


Var(Z) = 1. 


So far we have shown the following: 


If Z ~ 1V(0, l),then^Z = OandVar(^) = 1. 


CDF of the standard normal 

To find the CDF of the standard normal distribution, we need to integrate the PDF function. In particular, we have 


FAz) = vWL eip f tK 


This integral does not have a closed form solution. Nevertheless, because of the importance of the normal distribution, the values of Fz(z) 
have been tabulated and many calculators and software packages have this function. We usually denote the standard normal CDF by $. 

The CDF of the standard normal distribution is denoted by the $ function: 

i(x) = P(Z<x) = J=J_jx P {-^}du. 


As we will see in a moment, the CDF of any normal random variable can be written in terms of the $ function, so the $ function is widely 
used in probability. Figure 4.7 shows the $ function. 
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Here are some properties of the $ function that can be shown from its definition. 

1. lim $(tc) = 1, lim $(tc) = 0; 

x—>oo x—>—oo 

2. $(0) = i; 

3. $( — x) = 1 — 4>(:r), for all X € R. 

Also, since the $ function does not have a closed form, it is sometimes useful to use upper or lower bounds. In particular we can state the 
following bounds (see Problem 7 in the Solved Problems section). For all X > 0, 


1 X 

\/2tt x 2 + 1 



< 1 — $(tc) < 



(4.7) 


As we mentioned earlier, because of the importance of the nonnal distribution, the values of the $ function have been tabulated and many 
calculators and software packages have this function. For example, you can use the normcdf command in MATLAB to compute $ (x) for a 
given number X. More specifically, normcdf (x) returns 4?(;c). Also, the function norminv returns That is, if you run 

X = norminv(y), then X will be the real number for which 4? (at) = y. 


Nonnal random variables 

Now that we have seen the standard normal random variable, we can obtain any nonnal random variable by shifting and scaling a standard 
normal random variable. In particular, define 

X = aZ + /i, where <7 > 0. 

Then 

EX = crEZ + y, = y, 

Var(V) = cr 2 Var(Z) = <r 2 . 

We say that X is a normal random variable with mean )1 and variance <7 2 . We write X ~ A r (/ /, cr 2 ). 

If Z is a standard nonnal random variable and X — crZ -\~ //,. then X is a normal random variable with mean //, and variance <T 2 , i.e, 

N(»,ct 2 ). 
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Conversely, if X ~ N(jl, <7 2 ), the random variable defined by Z = — -V— is a standard normal random variable, i.e., Z ~ iV(0, 1). To 
find the CDF of X ~ iV(/X, U 2 ), we can write 

F x (x)=P{X< x) 

= P(aZ + fi < x) (where Z ~ V(0,1)) 

= P (z < 

= 4 (V) ■ 

To find the PDF, we can take the derivative of Fx , 


fx{x)=±F x {x) 



Figure 4.8 shows the PDF of the normal distribution for several values of fl and (7. 
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Example 4.11 

Let X ~ iV(-5,4). 

a. Find P(X < 0). 

b. Find P( — 7 < X < -3). 

c. FindP(X > — 3|V > —5). 


Solution 

o X is a normal random variable with /i = — 5 and (7 — y4 = 2, thus we have 
a. Find P[X < 0): 


P(X<0) = F x (0) 
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= $ 


0 -(— 5 ) 


$(2.5) « 0.99 


b. Find P(—7 < X < -3): 

P(-7 < X < -3) = F x (- 3) - F x (-7) 


= $ 


(-3)-(-5) ^ 


$ 


(~ 7 )-(~ 5 ) ^ 


= $(1) - $(-l) 

= 2$(1) — 1 (since $(— x) = 1 — $(ai)) 

« 0.68 


c. Find P(X > —3|X > —5): 


P(X> -3\X> —5) = 


P(X>-3,X>-5) 
P(X>- 5) 
P(X>—3) 
P(X>- 5) 


l-$ 


(-3)-(-5) 


l-$ 


(-5)-(-5) 


l-$(0) 

0.1587 

0.5 


0.32 


An important and useful property of the normal distribution is that a linear transformation of a normal random variable is itself a normal 
random variable. In particular, we have the following theorem: 

Theorem 4.3 

IfX ~ N(fi x , a^-), and Y = 

aX + b, where a,b £ R, then Y ~ N(fly, O’y) where 


fiy = afi x 4 -b, <Ty = a 2 a 

Proof 


We can write 

X — <j x Z + /i x where Z ~ N(0, 1). 

Thus, 

Y = aX+b 

= a(a x Z + fi x ) 4- b 
= (a^x)Z + (a^ x +b). 

Therefore, 

Y ~ N(a/j, x + b,a 2 a\). 


<— previous 
next —> 
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